Papers by A S M Iftekhar
Jailbreak Distillation: Renewable Safety Benchmarking (2025.findings-emnlp)
Copied to clipboard
Jingyu Zhang, Ahmed Elgohary, Xiawei Wang, A S M Iftekhar, Ahmed Magooda, Benjamin Van Durme, Daniel Khashabi, Kyle Jackson
| Challenge: | a new framework for safety benchmarking is being developed for large language models . the framework "distills" jailbreak attacks into high-quality and easily-updatable safety benchmarks . |
| Approach: | They propose a framework that "distills" jailbreak attacks into high-quality safety benchmarks. |
| Outcome: | The proposed framework "distills" jailbreak attacks into high-quality safety benchmarks . it requires minimal human effort to rerun the pipeline and produce updated benchmarks. |
SIRAJ: Diverse and Efficient Red-Teaming for LLM Agents via Distilled Structured Reasoning (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing red-teaming frameworks do not cover all the risks associated with arbitrary black-box LLMs. |
| Approach: | They propose a generic red-teaming framework for arbitrary black-box LLM agents that iteratively constructs and refines model-based adversarial attacks based on the execution trajectories of former attempts. |
| Outcome: | The proposed model improves attack success rate by 100%, surpassing the 671B Deepseek-R1 model. |